Computing proximal points of nonconvex functions
نویسندگان
چکیده
The proximal point mapping is the basis of many optimization techniques for convex functions. By means of variational analysis, the concept of proximal mapping was recently extended to nonconvex functions that are prox-regular and prox-bounded. In such a setting, the proximal point mapping is locally Lipschitz continuous and its set of fixed points coincide with the critical points of the original function. This suggests that the many uses of proximal points, and their corresponding proximal envelopes (Moreau envelopes), will have a natural extension from Convex Optimization to Nonconvex Optimization. For example, the inexact proximal point methods for convex optimization might be redesigned to work for nonconvex functions. In order to begin the practical implementation of proximal points in a nonconvex setting, a first crucial step would be to design efficient methods of approximating nonconvex proximal points. This would provide a solid foundation on which future design and analysis for nonconvex proximal point methods could flourish. In this paper we present a methodology based on the computation of proximal points of piecewise affine models of the nonconvex function. These models can be built with only the knowledge obtained from a black box providing, for each point, the function value and one subgradient. Convergence of the method is proved for the class of nonconvex functions that are prox-bounded and lower-C and encouraging preliminary numerical testing is reported.
منابع مشابه
Benchmark of Some Nonsmooth Optimization Solvers for Computing Nonconvex Proximal Points
The major focus of this work is to compare several methods for computing the proximal point of a nonconvex function via numerical testing. To do this, we introduce two techniques for randomly generating challenging nonconvex test functions, as well as two very specific test functions which should be of future interest to Nonconvex Optimization Benchmarking. We then compare the effectiveness of ...
متن کاملConvergence Analysis of Proximal Gradient with Momentum for Nonconvex Optimization
In many modern machine learning applications, structures of underlying mathematical models often yield nonconvex optimization problems. Due to the intractability of nonconvexity, there is a rising need to develop efficient methods for solving general nonconvex problems with certain performance guarantee. In this work, we investigate the accelerated proximal gradient method for nonconvex program...
متن کاملCommon best proximity points for $(psi-phi)$-generalized weak proximal contraction type mappings
In this paper, we introduce a pair of generalized proximal contraction mappings and prove the existence of a unique best proximity point for such mappings in a complete metric space. We provide examples to illustrate our result. Our result extends some of the results in the literature.
متن کاملA Proximal Bundle Method for Nonconvex Functions with Inexact Oracles
For a class of nonconvex nonsmooth functions, we consider the problem of computing an approximate critical point, in the case of inexact oracles. The latter means that only an inexact function value and an inexact subgradient are available, at any given point. We assume that the errors in function and subgradient evaluations are merely bounded, and in principle need not vanish in the limit. We ...
متن کاملA proximal bundle method for nonsmooth nonconvex functions with inexact information
For a class of nonconvex nonsmooth functions, we consider the problem of computing an approximate critical point, in the case when only inexact information about the function and subgradient values is available. We assume that the errors in function and subgradient evaluations are merely bounded, and in principle need not vanish in the limit. We examine the redistributed proximal bundle approac...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Math. Program.
دوره 116 شماره
صفحات -
تاریخ انتشار 2009